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METHOD OF DERIVING SPECTRAL SENSITIVITY CHARACTERISTICS 
FOR COLOR IMAGE INPUTTING DEVICE AND APPARATUS FOR SAME 

BACKGROUND OF THE INVENTION 

5 

1. Field of the Invention 

The present invention relates to a method for deriving spectral 
sensitivity characteristics suitably used for obtaining the spectral sensitivity 
characteristic in a color image inputting device, in particular, in a color 
10 scanner, and to an apparatus for the same. 

2. Description of the Related Art 

It is becoming important to accurately reproduce colors of an original 
subject from color image signals taken from a color image signal input device 
15 such as color scanners, digital cameras or a like achieving remarkably 
widespread use in recent years by using a color image signal output device 
such as color monitors, color printers or a like. 

In response to such needs, a method of image processing is disclosed 
(for example, in Japanese Patent Application No. Hei 7-20585) in which a 
20 color adjustment is made to colors produced from an image signal inputted 
from the color image signal input device. In the disclosed image processing, 
the image signal inputted from the color image signal input device is 
transformed to image data (X, Y and Z values) in a CIE (Commisson 
Internationale de L'eclarge) XYZ colorimetric system and, after the 
25 transformed image data has been transformed to data (L*, a* and b* values) 
in a uniform color space (for example, CIE LAB color space) based on a 
reference white, colors desired to be amended are designated and the 
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designated colors are again transformed to the image data (X', Y' and Z' 
values) in the CIE XYZ colorimetric system by increasing and decreasing the 
L*, a*, b* values according a difference between the color space data 
possessed by the designated color and color space data obtained after the 
transforming processing. In the image processing, since an increased and 
decreased amount of each of coordinate component values making up color 
space data is calibrated while seeing the input image by a monitor, it is 
possible to make the amendment to the input image so as to have a desired 
color balance. 

Thus, in the conventional technology in which the image processing 
is performed by using the X, Y and Z values in the CIE XYZ system or the L*, 
a*, b* in the CIE LAB color space, color matching functions in the CIE XYZ 
colorimetric system are used as standard color matching functions. However, 
it is generally impossible to make equal the X, Y and Z values of two stimuli 
each having a different spectral reflectance factor perceived to be the same in 
color in a specific illuminant, by observation in a specific color matching 
evaluation experiment, by using the color matching functions in the CIE 
XYZ colorimetric system. Due to this, two stimuli perceived by the 
observation to be same in color in the specific illuminant are considered to be 
different in color and, as a result, after the input image signal is acquired, 
the color calibration is performed even on the color stimuli requiring no 
amendment. 

That is, in the conventional image processing, to transform color data 
in a colorimetric system taken from the color image input device to that in 
other colorimetric system, it is necessary to obtain spectral sensitivity 
characteristics of the input device. The spectral sensitivity characteristics 
are represented by tristimulus values and each stimulus value is calculated 



by using a standard color matching function designated by the CIE. However, 
when the standard color matching function designated by the CIE is used, 
even a color perceived by a human to be the same in color is considered to be 
different in color and therefore it is impossible to obtain proper spectral 
5 sensitivity characteristics by the conventional method of deriving the 
spectral sensitivity characteristic and is difficult to achieve a proper 
transformation of color data by the conventional method. 

SUMMARY OF THE INVENTION 
10 In view of the above, it is an object of the present invention to provide 

a novel and useful method for deriving spectral sensitivity characteristics 
of a color image input device to transform data taken from the color image 
input device such as a color scanner or a like. 

According to a first aspect of the present invention, there is provided 
15 a method for deriving spectral sensitivity characteristics of the color image 
input device, including: 

a step of setting a constraint that tristimulus values of metamer data 
perceived to be the same in color by observation in a color matching 
evaluation experiment are made equal, to the metamer data; 
20 a step of obtaining a third objective function by assigning weights to 

a first objective function including a standard color matching function and to 
a second objective function in a uniform color space and by binding these two 
objective functions together; 

a step of obtaining, by using the method of Lagrange multipliers, a 
25 correcting color matching function used for correction to make the third 
objective function minimum under the constraint; 

a step of obtaining an amended color matching function to be 
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amended based on a sum of the obtained correcting color matching function 
and the standard color matching function; and 

a step of obtaining spectral sensitivity characteristics amended by 
using the amended color matching function. 
5 In the foregoing, a preferable mode is one wherein the tristimulus 

values are CIE XYZ values and wherein the first objective function is a 
standard color matching function in a CIE XYZ colorimetric system and the 
second objective function is an objective function in CIE LAB color space. 

Also, a preferable mode is one wherein the metamer data includes 
10 spectral distribution data of light from an illuminant in an environment 
where the color matching evaluation experiment is performed, a spectral 
reflectance factor of a reference color stimulus used in the color matching 
evaluation experiment, and spectral reflectance factors of two or more color 
stimuli perceived to be the same in color as the reference color stimulus by 
15 observation in the color matching evaluation experiment. 

Also, a preferable mode is one that wherein includes a step of 
excluding an inexact metamer data that is observed in the color matching 
evaluation experiment. 

According to a second aspect of the present invention, there is 
20 provided a spectral sensitivity characteristic deriving apparatus for 
obtaining spectral sensitivity characteristics, including: 

a metamer data processing section to set a constraint that 
tristimulus values of metamer data perceived to be the same in color by 
observation in a color matching evaluation experiment are made equal, to 
25 the metamer data; 

an objective function setting section to obtain a third objective 
function by assigning weights to a first objective function including a 



standard color matching function and to a second objective function in a 
uniform color space and by binding these two objective functions together; 
and 

an amended color matching calculating and processing section to 
5 obtain, by using the method of Lagrange multipliers, a correcting color 
matching function used for correction to make the third objective function 
minimum under the constraint, to obtain an amended color matching 
function to be amended based on a sum of the obtained correcting color 
matching function and the standard color matching function and to obtain 
■ 10 spectral sensitivity characteristics amended by using the amended color 
3 matching function. 

■'! In the foregoing, a preferable mode is one wherein the metamer data 

j processing section sets the constraint that CIE XYZ values of metamer data 

■J 

are made equal, to the metamer data. 
;;] 15 Also, a preferable mode is one wherein the objective function setting 

s section obtains the third objective function from the standard color matching 

function in the CIE XYZ colorimetric system being the first objective function 

and an objective function in a CIE LAB color space being the second objective 

function. 

20 Also, a preferable mode is one wherein the metamer data includes 

spectral distribution data of light from an illuminant in an environment 
where the color matching evaluation experiment is performed, a spectral 
reflectance factor of a reference color stimulus used in the color matching 
evaluation experiment, and spectral reflectance factors of two or more color 

25 stimuli perceived to be the same in color as the reference color stimulus by 
observation in the color matching evaluation experiment. 

Furthermore, a preferable mode is one that wherein includes a 
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conditional expression judgement processing section to exclude an inexact 
metamer data that is observed in the color matching evaluation experiment. 

With the above configurations, the correcting color matching function 
is calculated which minimizes the third objective function obtained by 
5 inputting the pair of spectral reflectance factors of the metamer data 
perceived to be the same in color by observation in the color matching 
evaluation experiment and, under the constraint that the CIE XYZ values of 
the noise averaged metamer data are made equal, by assigning weights to 
the first objective function in the CIE XYZ colorimetric system and to the 

10 second objective function in the CIE LAB color space and by binding these 
two objective functions together and then the amended color matching 
function that is to be amended based on the sum of the obtained correcting 
color matching function and the standard color matching function is 
calculated. By taking the minimization of the objective function into 

15 consideration, no difference is found in the form on a chromaticity diagram 
between the amended color matching function to be calculated and the 
standard color matching function and near values are provided by 
corresponding points between the amended color matching function and the 
standard color matching in the CIE LAB color space. Moreover, under the set 

20 constraint, by using the amended color matching function, the X, Y and Z 
values of the metamer data obtained from the color matching evaluation 
experiment can be made equal. By performing the linear transformation on 
the amended color matching function having such characteristics as 
described above, the properly-amended spectral sensitivity characteristics of 

25 the color image inputting device can be derived. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
The above and other objects, advantages and features of the present 
invention will be more apparent from the following description taken in 
conjunction with the accompanying drawings in which: 

FIG. 1 is a block diagram showing a spectral sensitivity characteristic 
deriving apparatus according to a first embodiment; 

FIG. 2 is a block diagram showing, in detail, the metamer data 
processing section shown in FIG. 1; 

FIG. 3 is a block diagram showing, in detail, an objective function 
setting section in the spectral sensitivity characteristic deriving apparatus 
shown in FIG. 1; 

FIG. 4 is a block diagram showing, in detail, a amended color 
matching function calculating and processing section in the spectral 
sensitivity characteristic deriving apparatus shown in FIG. 1; 

FIG. 5 is a block diagram showing a spectral sensitivity 
characteristic deriving apparatus according to a second embodiment; and 

FIG. 6 is a block diagram showing a conditional expression 
judgement processing section in the spectral sensitivity characteristic 
deriving apparatus shown in FIG. 5. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
Best modes of carrying out the present invention will be described in 
further detail using various embodiments with reference to the 
accompanying drawings. 

First Embodiment 
Configurations of the first embodiment will be described in detail by 



referring to FIGS. 1, 2, 3 and 4. FIG. 1 is a block diagram showing an entire 
processing system of the first embodiment. First, an outline of an entire 
system of the image processing of the embodiment will be explained. 

The color image input device of the present invention has a spectral 
5 sensitivity characteristic deriving apparatus used to obtain spectral 
sensitivity characteristics and the spectral sensitivity characteristic deriving 
apparatus, as shown in FIG. 1, includes a metamer data processing section 
001, a standard color matching function storing section 002 used to store a 
standard color matching function being a first color matching function, an 

10 objective function setting section 003, an amended color matching function 
calculating and processing section 004 used to calculate an amended color 
matching function and a spectral sensitivity characteristic deriving section 
005 used to calculate the spectral sensitivity characteristics of the color 
image input device using the amended color matching function. The color 

15 image input device includes, for example, an image input device such as a 
color scanner. 

The metamer data processing section 001 performs processing of the 
metamer data determined in a color matching evaluation experiment. The 
standard color matching function storing section 002 stores color matching 
20 functions in the CIE XYZ colorimetric system shown in the following 
expression (1). 

3c(A), y(X), z(X) ( 1 ) 

25 The objective function setting section 003 performs setting of a third 

objective function (described later) using the color matching function stored 
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in the standard color matching function storing section 002, that is, a first 
objective function. 

The amended color matching function calculating and processing 
section 004, in order to handle a problem of minimization of the third 
objective function set by the objective function setting section 003, under the 
constraint determined by the metamer data processing section 001, 
calculates the correcting color matching function for the correction to make 
the third objective function minimum by using the method of Lagrange 
multipliers and calculates the amended color matching function that has 
been amended by using the correcting color matching function. The amended 
color matching function to be calculated here is used to make equal the XYZ 
values of color stimuli that have been perceived to be the same in color by 
observation in the color matching evaluation experiment. The spectral 
sensitivity characteristic deriving section 005 performs linear 
transformation of the amended color matching function calculated by the 
amended color matching function calculating and processing section 004 in 
order to obtain the spectral sensitivity characteristics of the color image 
inputting device. 

FIG. 2 is a block diagram showing, in detail, the metamer data 
processing section 001 in the spectral sensitivity characteristic deriving 
apparatus shown in FIG. 1. 

The metamer data inputting section 101 reads spectral distribution 
data S ( X ) of light from an illuminant in an environment where the color 
matching experiment is performed, spectral reflectance factors of reference 
color stimuli used in the color matching experiment which are given by the 
expression (2) and spectral reflectance factors of n-pieces of color stimuli 
perceived by observation to be the same color as the reference color stimuli 
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which are represented by the expression (3). 



(2) 



\p^a) :i = l,-,n] 



(3) 



The metamer data storing section 102 stores the spectral 
distribution data S ( X ) of the light from the illuminant read by the metamer 
data inputting section 101, spectral reflectance factors p r (X) of reference 
color stimuli and spectral reflectance factors p^(X) of n-pieces of color 

stimuli perceived by observation to have the same color as the reference color 
stimuli. 

The noise averaging section 103 calculates the spectral distribution 
data A J ( X ) obtained by averaging a product of a difference in the 
metamer data and the spectral distribution data S ( I ) of the light from the 
illuminant. The difference in the metamer data is represented by the 
following expression (4). 



The spectral distribution data A J ( X ) storing section 104 stores the 
distribution data A J ( X ) calculated by the noise averaging section 103. 

FIG. 3 is a block diagram showing, in detail, the objective function 
setting section 003 of the spectral sensitivity characteristic deriving 
apparatus shown in FIG. 1. The Xw, Yw, Zw values storing section 201 stores 



p^(X)- Pr (X) 



(4) 
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Xw, Yw and Zw values being the CIE XYZ values at a white point in a 
specific illuminant (here, standard illuminant D65). The matrix U ( X ) 
calculating section 202 receives the CIE XYZ values at the white point stored 
in the Xw, Yw, Zw values storing section 201 and the color function in the 
5 CIE XYZ colorimetric system which is the first objective function stored in 
the standard color matching function storing section 002 shown in FIG. 1 
and calculates a matrix U(X) represented by a determinant (6) which 
designates a second objective function to be employed in the uniform color 
space (here, CIE LAB color space). 

□ 10 

a 

H 0(A) (6) 

m 
rij 

y - The y 1, y 2 inputting section 203 reads weighing coefficient 

parameters y 1 and y 2. The parameters y 1 and y 2 are the weighing 
Hi 15 coefficients required when the objective function in the CIE XYZ colorimetric 

m 

O system is bound to the objective function in the CIE LAB color space. The y 1, 

y 2 storing section 204 stores the weighing coefficient parameters y 1 and y 2 
read by the y 1, y 2 inputting section 203. 

The matrix M ( X ) calculating section 205 receives the matrix 

20 represented by the expression (6) to designate the objective function in the 
CIE LAB color space from the matrix U ( I ) calculating section 202 and the 
weighing coefficient parameters y 1 and 7 2 from they 1, y 2 storing section 
204 and binds the first objective function in the CIE XYZ colorimetric system 
to the second objective function in the CIE LAB colorimetric system and then 

25 calculates a matrix represented by the expression (8) which designates a 
third objective function to be obtained after the binding. 
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M(A) 



(8) 



The inverse matrix calculating section 206 used to calculate an 



5 inverse matrix of a matrix M{X) receives the matrix M(A) represented by 
the expression (8) from the matrix M ( X ) calculating section 205 and 
calculates the inverse matrix M~\X) represented by the expression (9). The 
inverse matrix storing section 207 stores the inverse matrix M~'(A) . 



FIG. 4 is a block diagram showing, in detail, the amended color 
matching function calculating and processing section 004 in the spectral 
sensitivity characteristic deriving apparatus shown in FIG. 1. The matrix K 
15 calculating section 301 receives the distribution data A J (X) from the 
distribution data A J ( X ) storing section 104 in the metamer data 
processing section 001 and the inverse matrix represented by the expression 

(9) from the inverse matrix storing section 207 in the objective function 
setting section 003 and calculates the matrix represented by the expression 

20 (10) required to determine an undetermined multiplier. The K's inverse 
matrix calculating section 302 calculates the inverse matrix represented by 
the expression (11) which is the inverse matrix represented by the expression 

(10) calculated by the matrix K calculating section 301. 
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(9) 



25 



k 



(1 0) 
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(11) 



The undetermined multiplier calculating section 303 receives the 
5 distribution data A J ( X ) from the distribution data A J ( X ) storing 
section 104, the color matching function in the CIE XYZ colorimetric 

system and the inverse matrix K~ x represented by the expression (11) 
calculated in the K's inverse matrix calculating section 302 and calculates 
the undetermined multiplier according to the method of Lagrange 

10 multipliers. The amended color matching function calculating section 304 
receives the distribution data A J ( X ) from the distribution data A J ( X ) 
storing section 104, the color matching function in the CIE XYZ colorimetric 
system from the standard color matching function storing section 002, the 
inverse matrix M"'(A) represented by the expression (9) from the the 

15 inverse matrix storing section 207 used to store the inverse matrix of M (X) 
and the undetermined multiplier calculated by the undetermined multiplier 
calculating section 303, that is, a determined multiplier, and calculates the 
amended color matching function. 

Next, operations for the method for amending the spectral sensitivity 

20 characteristics by the spectral sensitivity characteristic deriving apparatus 
having configurations as above of the first embodiment will be described in 
detail by referring to FIGS. 1, 2, 3 and 4. 

First, operations of the metamer data processing section 001 shown 
in FIG 2 will be explained. The metamer denotes two color stimuli each 

25 having a different spectral reflectance factor perceived to be the same in 
color under a specified condition of light from the illuminant. Here, spectral 



distribution data S ( X ) of light from the illuminant used in an environment 
where the color matching experiment is performed, the spectral reflectance 
factor, represented by the expression (2), of the reference color stimulus used 
in the color matching experiment and spectral reflectance factors 
5 represented by the expression (3) which are spectral reflectance factors of n- 
pieces of the color stimuli perceived to be the same as the reference color 
stimuli by the observation in the color matching evaluation experiment are 
called "metamer data". 

The metamer data inputting section 101 reads these data and the 

10 metamer data storing section 102 stores the metamer data read by the 
metamer data inputting section 101. The metamer data processing section 
001 is used to set the constraint required when an optimization problem is to 
be solved. Ordinarily, the CIE XYZ values for these metamer data observed 
as the same color in the color matching evaluation experiment are not equal. 

15 The relation of this disagreement is represented by an ineguality (12). 



j5(A)p r (A)jc 1 (A)AA * XsWp^^jc.WAA, 

A A 

^5(A)p r (A)]c 2 (A)AA * 5^5(A)p^(A)5c 2 (A)AA, (12) 

X5(A)p r (A)x 3 (A)AA * xsa^'a^a^A. 



where each of "x,(A), x,(A), x 3 (A) " denotes color matching functions 
20 "x(X), y(X), in the CIE XYZ colorimetric system and where the sum 

(^T ) denotes a sum in a visible wavelength band and A X denotes a 

A 

discretized interval of a wavelength. 

The amended color matching function to be obtained is represented 
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by the expression (16). The amended color matching function is represented 
by a sum of the standard color matching function given by the expression 
(17) and the correcting color matching function given by the expression (18) 
for correction. The relation between them is represented by the expression 
(19). 

frax^ax^a)) ne) 

ft (A), 5c 2 (A), 5c 3 (A)) (17) 

(Axj(A),Ax 2 (A),A*,(A)) (18) 

5c, (A) = 5c, (A) + Ax, (A), / = 1,2,3. (19) 

It is necessary to have the amended color matching function make 
equal the CIE XYZ values of the metamer data observed in the color 
matching evaluation experiment. The condition for this is given by the 
expression (20). 

£A/(A)x,(A) = 0, i = 1,2,3. (2 0) 

Here, the spectral distribution data A J ( X ) is represented by the 
expression (21). 
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A/ (A) 



= ^25(A)(p^(A)-p,(A)) 



(2 1) 



The expression (20) shows the constraint imposed when the amended color 
matching function is calculated. The noise averaging section 103 calculates 
5 the spectral distribution data A J ( X ) obtained by averaging a product of a 
difference in the metamer data represented by the expression (4) and the 
spectral distribution data S (X) of the light from the illuminant. The 
distribution data A J ( X ) storing section 104 stores the spectral 
distribution data A J (X) calculated by the noise averaging section 103. 
10 Next, operations of the objective function setting section 003 in the 

spectral sensitivity characteristic deriving apparatus shown in FIG 3 will be 
explained. The objective function setting section 003 sets a third objective 
function required to determine the amended color matching function. 



n 15 with respect to the wavelength A. which is represented by the expression 

(22) . It is thought that the third objective function can be obtained by 
assigning weights to a first objective function represented by the expression 

(23) in the CIE XYZ colorimetric system and to a second objective function 
represented by the expression (24) in the CIE LAB colorimetric system and 

20 by binding these two functions together. 



The third objective function to be obtained is the objective function 



f(Ax(X)) 
/,(Ac(A)) 



(2 2) 



(2 3) 



(2 4) 
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However, " Ax(X) " satisfies a relation given by the following expression (25). 



Ax(X) = (Ax, (A), Ax 2 (X), Ax 3 (A)) (25) 

As the first objective function in the CIE XYZ colorimetric system, 
the following expression (26) is employed. 

The expression (26) shows a total sum of the square of variations 
represented by the expression (27) with respect to the wavelength X of the 
correcting color matching function. The minimization of the first objective 
function represented by the expression (23) is equivalent to the minimization 
of the variations represented by the expression (27). 

f^Axa)^ = X(5c,a)-x,a)) 2 = J> ( 2 a). (2 6) 

Ax ; (/l) (2 7) 

As the second objective function in the CIE LAB color space, the 
expression (28) is employed. 
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(2 8) 



where each of values represented by a first term, second term and third term 
of the left side denotes a difference in quantity being equal to sensitivity in 
5 L*, a*, b* in the CIE LAB color space and, as the function g ( a ), either of 
the expressions (29a) or (29b) is selected according to the value " a ". 



g(a) = d" (29a) 

however, a > 0.00856 

5 io 

B 

H g(a) = 7.787a + 1 6/1 1 6 (2 9 b) 

m 

fj however, a 5 0.00856 

w 

The minimization of the second objective function / 2 (Av(A)) is 
ffj 15 equivalent to the minimization of a difference in quantity being equal to 
li sensitivity in the L*, a*, b* in the CIE LAB color space. 

Since a case is considered where the variation Ax, (A) is sufficiently 

smaller compared with the standard color matching function x,(A) , after the 
Taylor's series expansion is performed and when the calculation is made to 
20 the second degree, the objective function in the CIE LAB color space is 
represented by the expression (31). 



(3 1 ) 
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where '() denotes transposition and the matrix U(X) is a real symmetric 
matrix represented by the expression (33). 



u u (X) u n (X)^ 
u l2 (X) u 22 {X) w 23 (A) 
u J? (A) u 23 (A) u 33 (X) 



(3 3) 



however, each of the matrix elements is as follows. 



"11(A) 
u 22 {X) 
w 33 (A) 



3c, (A) 



116 2 +500 2 +200 2 f / x 2 (A) 



* 3 (A) 



" 2 3 a) 

« 33 (A) = 0. 



200 2 /^O) 1 / gjjjj 



(3 4) 



10 Here, the following expression (35) is used. 



*'(/*) 



<*g(«) 
da I 



(3 5) 



The matrix U ( X ) calculating section 202, as described above, 
15 receives the CIE XYZ values at the white point stored in the Xw, Yw, Zw 
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values storing section 201 and the color function in the CIE XYZ colorimetric 
system and calculates a matrix represented by the expression (33) which 
designates the objective function in the CIE LAB color space. 

The third objective function represented by the expression (22) is 
obtained by assigning weights to the first objective function in the CIE XYZ 
colorimetric system and to the second objective function in the CIE LAB 
colorimetric system and by binding them together and is given by the 
following expression (36). 

f^AxU)^ = 7l /^Ai(A)j + y 2 / 2 ^(A)j = Ax( A) M (A) | Ax(l) j (3 6) 

However, " y 1, y 2" are real positive numbers. The matrix M(A) is given as 
a real symmetric matrix as shown by the expression (37). 



M{X) = 
15 (3 7) 



m u (A) ra 12 (A) to i3 (A)^ 
m l2 (A) m 22 (A) m 23 (A) 
ra 13 (A) m 23 (A) >« 33 (A) 



y { +Y 2 u u {X) y 2 w l2 (A) y 2 w 13 (A) ' 
y 2 w 12 (A) y,+j 2 u 22 {X) y 2 u 23 (A) 
y 2 u n {K) y 2 u 23 (l) y x +y 2 u^{l) 



The 7 1, 7 2 inputting section 203 shown in FIG. 3 reads the weighing 
coefficient parameters y 1 and 7 2 and the read parameters 7 1 and 7 2 are 
stored in the 71,72 storing section 204. Moreover, the matrix M ( A ) 
calculating section 205 receives the matrix represented by the expression 
(33) from the matrix U ( A ) calculating section 202 and the weighing 
coefficient parameters 7 1 and 7 2 from the 7 1, 7 2 storing section 204, and by 
using them, calculates the matrix represented by the expression (37). 

The inverse matrix calculating section 206 used to calculate an 
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inverse matrix of the matrix M (X) receives the matrix represented by the 
expression (37) from the matrix M ( X ) calculating section 205 and calculates 
the inverse matrix M"'(/L) represented by the expression (9) which is 
required in the subsequent calculating process. The inverse matrix storing 
5 section 207 stores the inverse matrix represented by the expression (9) and 
calculated by the inverse matrix calculating section 206. 

Next, operations of the amended color matching function calculating 
and processing section 004 shown in FIG. 4 will be described. The amended 
color matching function calculating and processing section 004 calculates, 

10 under the constraint set by the metamer data processing section 001 shown 
in FIG. 1, the correcting color matching function used to minimize the third 
objective function set by the objective function setting section 003 and, at the 
same time, an amended color matching function to be obtained from the sum 
of the calculated correcting color matching function and the standard color 

15 matching function. 

To solve the optimization problem in which a variation Ax(X) is to be 
obtained which satisfies the constraint represented by the expression (20) 

and minimizes the objective function /(Ax(A)) , the method of Lagrange 

A 

multipliers is used. The Lagrange's function is given by the expression (40). 

20 
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where, /Li = fJL 2 , ^ ) is the Lagrange's undetermined multiplier. 

Since a result is 0 (zero) when the Lagrange's function F is partially 
differentiated with respect with Ax(X), the above variation Ax(A) is 
represented by the expression (42). 



Ax(X) 



AJ(X)M~\X)^i, 



(42) 



By substituting the expression (42) representing the variation Ax(X) for the 
constraint, the undetermined multiplier is determined as shown by the 
expression (43). 



x 2 (X) 

x 3 a) 



(4 3) 



However, the matrix K 1 is the real symmetric matrix of 3 x 3, which is 
represented by the expression (44). 



k = ^I> 2 a)M-\ 

2 a 



(44) 



The matrix K calculating section 301 receives the distribution data 
A J (X) from the distribution data A J (X) storing section 104 in the 
metamer data processing section 001 and the inverse matrix M~\X) of 
M( X ) from 
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the inverse matrix storing section 207 in the objective function setting 
section 003 and calculates the matrix K represented by the expression (10). 
The K' inverse matrix calculating section 302 calculates the inverse matrix 
K~'(A) of the matrix K calculated by the matrix K calculating section 301. 

The undetermined multiplier calculating section 303 receives the 
distribution data A J (X) from the distribution data A J (X) storing 
section 104, the color matching function in the CIE XYZ colorimetric 
system from the standard color matching function storing section 002 and 
further the inverse matrix K~'(A) calculated by the K' inverse matrix 
calculating section 302 and, by using them, calculates the undetermined 
multiplier according to the method of Lagrange multipliers. 

By substituting the expression (42) for the expression (19), the 
expression (45) to obtain the amended color matching function can be 
derived. 







'xj(A)> 










3c 2 (A) 


+ -A/(A)M-'(A) 
2 















The amended color matching function calculating section 304 
receives the distribution data A J ( X ) from the distribution data A J ( X ) 
storing section 104, the color matching function in the CIE XYZ colorimetric 
system from the standard color matching function storing section 002, the 
inverse matrix M~'(A) from the inverse matrix storing section 207 of M (X) 
and the undetermined multiplier calculated by the undetermined multiplier 
calculating section 303 and, by substituting them for the expression (45) and 
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by performing an operation, calculates the amended color matching function 
represented by the left term of the expression (45). 

The spectral sensitivity characteristic deriving section 005 shown in 
FIG. 1, in order to derive the spectral sensitivity characteristic of the color 
5 image inputting device from the amended color matching function calculated 
by the amended color matching function calculating and processing section 
004, performs well-known linear transformation on the amended color 
matching functions. 

The relation among the spectral sensitivity characteristics 

10 (r(A), g(A), b{X)) of the color image inputting device, and a matrix V 
representing linear transformation from the standard color matching 
function (x,(A), x 2 (A), * 3 (A)) is represented by the following expression (48). 
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where "(r(A), g(A),£(A))" denotes the spectral sensitivity characteristic of the 
color image inputting device, "(x,(2), 3c 2 (A), 3c 3 (A))" denotes the standard color 

matching function and " V " denotes the matrix obtained by the linear 
transformation from the standard color matching function. 
20 Based on the relation shown in the expression (48), the spectral 

sensitivity characteristic deriving section 005 of the present invention, using 
the expression (50), calculates the spectral sensitivity characteristic 
(r (A), g(A), 6(A)) obtained after the amendment from the amened color 
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matching function (jc,(A), x 2 (X), x,(A))and the matrix V . 













= V 
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5 Effects of first embodiment 

As described above, according to the first embodiment, by using each 
of the spectral reflectance factors of the pair of color stimuli being the 
metamer data observed as the same in color in the color matching evaluation 
experiment and each of the spectral reflectance factors of the color stimuli 

10 observed separately, under the constraint that the CIE XYZ values of the 
noise-averaged metamer data are made equal, the correcting color matching 
function is calculated which minimizes the third objective function obtained 
by assigning weights to the first objective function in the CIE XYZ 
colorimetric system and to the second objective function in the CIE LAB 

15 colorimetric system and binding them together and the amended color 
matching function is also calculated obtained by the amendment based on 
the sum of the correcting color matching function and the standard color 
matching function. By taking the minimization of the objective function into 
consideration, no difference is found in the form on a chromaticity diagram 

20 between the amended color matching function to be calculated and the 
standard color matching function and near values are provided by 
corresponding points between the amended color matching function and the 
standard color matching in the CIE LAB color space. Moreover, under the set 
constraint, by using the amended color matching function, the X value, Y 

25 value and Z value of the metamer data obtained from the color matching 

25 



evaluation experiment can be made equal. By performing the linear 
transformation on the amended color matching function having such 
characteristics as described above, the properly-amended spectral sensitivity 
characteristic of the color image inputting device can be derived. 

5 

Second Embodiment 
Configurations in the second embodiment will be described in detail 
by referring to FIGS. 5 and 6. FIG. 5 is a block diagram showing an entire 
processing system of the second embodiment. As in the first embodiment, a 

10 metamer data processing section 001, a standard color matching function 
storing section 002, a objective function setting section 003, a amended color 
matching function calculating and processing section 004 and a spectral 
sensitivity characteristic deriving section 005 are provided. In the second 
embodiment, in addition to these components provided in the first 

15 embodiment, a conditional expression judgement processing section 401 is 
provided. The conditional expression judgement processing section 401 
judges whether an amended color matching function calculated by the 
amended color matching function calculating and processing section 004. 
satisfies a condition. 

20 FIG. 6 is a block diagram showing details of the conditional 

expression judgement processing section 401 in FIG. 5. The conditional 
expression calculating section 501 receives a color matching function in the 
CIE XYZ colorimetric system from the standard color matching storing 
section 002 used to store a standard color matching function and an amended 

25 color matching function calculated by the conditional expression calculating 
section 501 using the same procedures as employed in the first embodiment 
from an amended color matching function calculating section 304 in the 
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amended color matching function calculating and processing section 004 and 
calculates a conditional expression to be satisfied by the amended color 
matching function. The tolerance storing section 503 stores, in advance, a 
tolerance value to be used in the conditional expression. The conditional 
expression judging section 502 receives the conditional expression to be 
satisfied by the amended color matching function from the conditional 
expression calculating section 501 and the tolerance value stored in the 
tolerance storing section 503 and judges whether the amended color 
matching function calculated by the amended color matching function 
calculating section 304 satisfies the conditional expression or not. 

Next, operations in the second embodiment will be explained in 
detail by referring to FIGS. 5 and 6. In FIG. 5, each of the metamer data 
processing section 001, standard color matching function storing section 002, 
objective function setting section 003, amended color matching function 
calculating and processing section 004 and spectral sensitivity characteristic 
deriving section has the same functions as in the first embodiment. The 
conditional expression judgement processing section 401 judges whether the 
amended color matching function calculated by the amended color matching 
function calculating and processing section 004 satisfies a condition or not. 

Operations of the conditional expression judgement processing 
section 401 shown in FIG. 6 will be explained. The conditional expression 
calculating section 501 receives a color matching function in the CIE XYZ 
colorimetric system being a first objective function represented by the 
expression (17) from the standard color matching function storing section 
002 and an amended color matching function represented by the expression 
(16) calculated by the conditional expression calculating section 501 using 
the same procedures as employed in the first embodiment and calculates the 
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conditional expression to be satisfied by the amended color matching 
function. The following expression (51) is used as the conditional expression. 

(X,a)-x,(A)) =ESAx ( (A) < (Const) (5 1) 

A 1=1 A i=l 

5 

Where "(Const)" denotes a tolerance stored in advance in the tolerance 
storing section 502. 

The conditional expression (51) is explained. The expression (51) 
represents a condition that a total sum of a square of the variation 

10 represented by the expression (27), that is, the total sum of the square of a 
differential between the amended color matching function represented by 
the expression (16) calculated by the amended color matching function 
calculating section 304 and the standard color matching function 
represented by the expression (17) in a visible wavelength band does not 

15 exceed a tolerance. 

When the amended color matching function represented by the 
expression (16) calculated by the amended color matching function 
calculating section 304 is to be obtained, if a weighing coefficient y 1 of the 
first objective function represented by the expression (23) for the CIE XYZ 

20 colorimetric system being sufficiently larger than the weighing coefficient y 2 
of the second objective function represented by the expression (24) for the 
CIE LAB color space to be assigned by the objective function setting section 
003 is used in the process of the calculation, under a constraint to minimize 
the variation A x x ( X ), a value expressed by a left side of a sign of 

25 inequality represented by the conditional expression (51), that is, a third 
objective function is made minimum. 
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However, if the metamer data used to set the constraint is inexact, 
there is a case where, even if the value expressed by the left side of the 
conditional expression (51), that is, the third objective function is a minimum, 
an absolute value of the minimum value becomes large, under the constraint. 
The inexact metamer data means those being insufficiently accurate in 
perception of a subject even with normal color vision who fails to perceive 
two colors as the same accurately in the color matching evaluation 
experiment or those obtained from the observation of a subject with 
abnormal color vision. For example, if the amended color matching function 
is calculated based on the metamer data obtained from the subject with 
abnormal color vision, the amended color matching function being greatly 
different from the standard color matching function is obtained, which 
causes the improper amended color matching function to be derived. For this 
reason, as the conditional expression to be satisfied by the amended color 
matching function, the expression (51) showing that the amended color 
matching function is not different greatly from the standard color matching 
function has to be set. 

The tolerance (Const) stored in the tolerance storing section 502 is a 
value obtained in advance by the color matching evaluation experiment. The 
conditional expression judgement section 503 receives the value expressed 
by the left side of the conditional expression (51) calculated by the 
conditional expression calculating section 501 and the tolerance value 
(Const) stored in the tolerance storing section 503 and judges whether the 
conditional expression (51) is true or false. The conditional expression 
judgement section 503, if the conditional expression is true, regards the 
amended color matching function calculated by the amended color matching 
calculating section 304 as a proper function and transfers it to the spectral 
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sensitivity characteristic calculating and processing section 005. The 
conditional expression judgement section 503, if the conditional expression is 
false, regards the amended color matching function calculated by the 
amended color matching calculating section 304 as an improper function and 
promotes the metamer data obtained from a different color matching 
evaluatin experiment to be again inputted from the metamer data inputting 
section 101 in the metamer data processing section 001 and repeats a series 
of the processing until the conditional expression (51) becomes true. This 
enables a proper amended color matching function to be obtained. 

Modified embodiment of second embodiment 

Other judgement conditions that can be employed by the conditional 
expression judgement processing section 401 shown in FIG. 6 will be 
explained. The conditional expression calculating section 501 receives the 
color matching function represented by the expression (17) in the CIE XYZ 
colorimetric system from the standard color matching function storing 
section 002 and the amended color matching function represented by the 
expression (16) by the conditional expression calculating section 501 using 
the procedures employed in the first embodiment from the amended color 
matching calculating section in the amended color matching function 
calculating and processing section 004 and calculates the conditional 
expression to be satisfied by the amended color matching function. As the 
conditional expression, instead of the expression (51), the following 
expression (52) is used which is set for every wavelength X . 

3 2 3 2 

£ (A)) =£Ax, (A) < (ConstXX). (5 2) 
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where "(Const) ( X ) " denotes a tolerance value stored in the tolerance storing 
section 502 for every wavelength X . 

This conditional expression (52) will be explained. The expression 
5 (52) represents a condition that the total sum of the square of a differential 
between the amended color matching function represented by the expression 

(16) calculated by the amended color matching function calculating section 
304 and the standard color matching function represented by the expression 

(17) , that is, a total sum of a square of the variation represented by the 
10 expression (27) does not exceed a tolerance. 

When the amended color matching function represented by the 
expression (16) calculated by the amended color matching function 
calculating section 304 is to be obtained, if a weighing coefficient 7 1 of the 
first objective function represented by the expression (23) for the CIE XYZ 

15 colorimetric system being sufficiently larger than the weighing coefficient 7 2 
of the second objective function represented by the expression (24) for the 
CIE LAB color space to be assigned by the objective function setting section 
003 is used in the process of the calculation, under a constraint to minimize 
the variation A x x ( X ), a value expressed by a left side of a sign of 

20 inequality represented by the conditional expression (52), that is, a third 
objective function is made minimum. 

However, if the metamer data used to set the constraint is inexact, 
there is a case where, even if the value expressed by the left side of the 
conditional expression (52), that is, the third objective function is a minimum, 

25 an absolute value of the minimum value becomes large, under the constraint. 
The inexact metamer data means those being insufficiently accurate in 
perception of a subject even with normal color vision who fails to perceive 
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two colors as the same accurately in the color matching evaluation 
experiment or those obtained from the observation of a subject with 
abnormal color vision. For example, if the amended color matching function 
is calculated based on the metamer data obtained from the subject with 
abnormal color vision, the amended color matching function being greatly 
different from the standard color matching function is obtained, which 
causes the improper amended color matching function to be derived. For this 
reason, as the conditional expression to be satisfied by the amended color 
matching function, the expression (52) showing that the amended color 
matching function is not different greatly from the standard color matching 
function has to be set. 

The tolerance (Const) ( X ) stored in the tolerance storing section 502 
is set in advance by the color matching evaluation experiment. The 
conditional expression judgement section 503 receives the value expressed 
by the left side of the conditional expression (52) calculated by the 
conditional expression calculating section 501 and the tolerance value 
(Const) ( X ) stored in the tolerance storing section 503 and judges whether 
the conditional expression (52) is true or false. The conditional expression 
judgement section 503, if the conditional expression (52) is true for all visible 
wavelength X , regards the amended color matching function calculated by 
the amended color matching calculating section 304 as a proper function and 
transfers it to the spectral sensitivity characteristic calculating and 
processing section 005. The conditional expression judgement section 503, if 
there is even one wavelength X for which the conditional expression (52) is 
false, regards the amended color matching function calculated by the 
amended color matching calculating section 304 as an improper function and 
promotes the metamer data obtained from a different color matching 
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evaluation experiment to be again inputted from the metamer data inputting 
section 101 in the metamer data processing section 001 and repeats a series 
of the processing until the conditional expression (52) becomes true for all 
visible wavelength X . This enables a proper amended color matching 
function to be obtained. 

As described above, according to the second embodiment, the 
amended color matching function can be calculated obtained by excluding 
the metamer data being insufficiently accurate in perception of the subject 
even with normal color vision who fails to perceive two colors as the same 
accurately in the color matching evaluation experiment or the metamer data 
obtained from the observation of the subject with abnormal color vision. By 
performing the linear transformation on the amended color matching 
function having such characteristics as described above, the properly- 
amended spectral sensitivity characteristic of the color image inputting 
device can be derived. 

It is thus apparent that the present invention is not limited to the 
above embodiments but may be changed and modified without departing 
from the scope and spirit of the invention. 
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